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Abstract — This paper studies the decoupling principle of a 
linear vector channel, which is an extension of CDMA and MIMO 
channels. We show that the scalar-channel characterization ob- 
tained via the decoupling principle is valid not only for collections 
of a large number of elements of input vector, as discussed in 
previous studies, but also for individual elements of input vector, 
i.e. the linear vector channel for individual elements of channel 
input vector is decomposed into a bank of independent scalar 
Gaussian channels in the large-system limit, where dimensions 
of channel input and output are both sent to infinity while their 
ratio fixed. 

I. Introduction 

Recently, the replica method, developed in statistical me- 
chanics, has been applied to problems of performance evalua- 
tion of various digital wireless communication systems, espe- 
cially code-division multiple-access (CDMA) and multi-input 
multi-output (MIMO) systems [l]-[4]. The replica method 
provides us with a description of these channels, called, the 
decoupling principle; that is, a CDMA channel, or equivalently 
a MIMO channel, is decoupled, under a certain randomness 
assumption of the channel, into a bank of independent scalar 
Gaussian channels in the large-system limit, where dimensions 
of channel input and output are both sent to infinity while their 
ratio fixed. 

Existing results of replica analysis, however, rely on saddle- 
point evaluation of integrals, which is only valid for evaluating 
macroscopic quantities, such as an empirical mean of many 
microscopic quantities, such as individual elements of input, 
which are many in the sense that their number goes to infinity 
as the dimensions of the system in the large-system limit. 
It is therefore not clear as to whether the scalar-channel 
characterization of CDMA or MIMO channels obtained via the 
replica analysis is still valid if we are interested in microscopic 
quantities in the large-system limit. 

In this paper we show that the scalar-channel characteriza- 
tion is still valid for microscopic quantities, by performing 
replica analysis on a linear vector channel, which is an 
extension of CDMA or MIMO channels. 

II. Linear Vector Channel 

We consider a /-C-input A^-output linear vector channel, 
defined as follows. Let Xq = {xqi, xqk)^ denote the 
input vector of the channel, and y = (yi, . . . , j/at)^ denote 
the output vector given a linear transform Hxq of the inputs, 
where H is an N x K channel matrix. Assuming the channel 



to be memoryless, the input-output characteristic of the linear 
vector channel is represented as 



N 



Poiy\Hxo) = ]J /Jo 



hf^xo 



N 



(1) 



where hj^/\/N denotes /ith row of H. We define a true 
prior as Po{x). Inference of the input vector x^, given 
the output vector y and the channel matrix H, can be 
solved by a detection scheme based on Bayesian inference. 
The detector assumes a channel model to be P{y\Hx) = 
Y['f!=i p(2/ai|^J^/v'^)' ^iid ^ prior distribution to be P{x). 
We also assume perfect channel state information at the 
detector. These assumptions yield the posterior distribution 



P{x\y, H) = 



P{y\Hx)P{x) 
J P{y\Hx)P{x)dx' 



(2) 



The posterior mean estimator (PME) x = J xP{x\y, H)dx 
is the optimal inference scheme to minimize the mean squared 
error, if the assumed model is matched to the true model. 

In this paper, we study joint distributions of L (^ K) 
elements of input vector and their estimates based on the 
posterior distribution dU, given a channel matrix H. Without 
loss of generality we consider the first L elements of input 
vector, a^Q = (xqi, . . . , x^l)^ , and their estimates x^ . The 
joint distribution to be studied is thus 

7^(4, x'^\H) = J P(a;^|y, H)Po{y\Hxo)Po{xo) dx]"- . 

(3) 

We assume the channel matrix H to be random and evaluate 
expectation of V{xq, x^\H) over H in the large-system limit 
where K, N ^ oo while /3 = K/N is kept finite; 

V[x^,x^)^ lim £h[V{x^,x'^\H)\. (4) 

K.N ^oo 

Eu[- ■ ■ ] denotes expectation over the random variable u. Note 
that if the scalar-channel characterization is derived for the 
joint distribution (|4|l using the replica method, it is easy 
to show the scalar-channel characterization is still valid for 
arbitrary microscopic quantities depend on Xq and x^. 
To simplify the analysis, we assume the following: 

« Random channel matrix: The elements {hf^k} are in- 
dependent and identically distributed (i.i.d.) with mean 



zero, unit variance, odd-order moments being zero and 
(2m) th-order moments being finite. 

• The first L elements of input vector and the remaining 
elements x^^ = {xo(L+l)^ • ■ • i x^xy ^re independent, 
so that the prior distribution of x is factorized as 

P^{x^)=P^{x^)P^\xY^). (5) 

The factorized form P{x) = P'^ {x^) p\^ [x^^) is also 
used as the postulated prior distribution. 

• The conditional distributions pQ{y\u) and p{y\u) are one 
and two times differentiable with respect to u, respec- 
tively. 

in. Main Result 

Our main result is the following claim. 

Claim 1: In the large-system limit and under the assump- 
tion of replica symmetry (see Sect. lIVI i. the joint distribution 
V{x^, x^) defined in dU is asymptotically equivalent to the 
joint distribution 



(6) 



lVb.=iPG{zkW)P'^{^'^)dx^ 

L 



k=l 



where pco{z\x) and pg{z\x) represent input-output character- 
istics of the scalar Gaussian channels 

E^{z-xf 



PGo{z\x) 

Pg{.z\x) 



2'kF 
E 



exp 



2F 



cxp 



E{z- 



(7) 
(8) 



respectively, and where = (zi, zl)^ ■ P^{x^) 
"modulated" version of the assumed prior, defined as 



P^{x^) = 



cxp 


G-F+E ^ 


P^{x^) 


/exp 


'g-f+e ||™L||2' 

2 ll"^ II 


P^{x^)dx^ 



(9) 



T 
X X. 



where ||a;|[ 

The parameters {G, E, F} are determined by solving the 
following equations for {G, E, F, r, to, q}, 



G = 



E 



F = 




p" jylVNt] 
p{v\VPqt) 

p' {vWFqt) 
p{y\V0qt) 

p'{y\VP^t) 
p{y\VPqt) 



■Dtdy, 
Dtdy, 



Dtdy, 



(10) 
(11) 

(12) 

(13) 
(14) 
(15) 



where J{---)Du = /^(- • • ) cxp(-wV2) du/\/2^. The 
distributions po and p are defined as 



po y 




Du, 



(16) 



(3qt+^(3{r-q)uj Du, (17) 



respectively, where f'{y\u) ~ -^f{y\u), and where 

1 fw l|2 

ro = lim — / \\xo\\ Po{xo)dxQ. 
K^oo K J " " 



(18) 



The brackets 



and 



denote the averages with respect 



to the joint distribution of Xq and z = (zi, 



ZK) 



K 



((•••))= //(•••)n PGo{zk\xok)Po{x^)dzdxo, (19) 



fc=i 



and the posterior distribution of x given z, 

^Y[k^lPG{zkW)P{x) 



S]\k=iPG{zk\xk)P{x)dx 



(20) 



respectively, where 

P{x) 



exp 


'g-f+e 
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|a;|| 


P{x) 


/cxp 


G-F+E 1 
2 1 


l|2" 

x\\ 


P{x)dx 



(21) 



If more than one solution exists for ([Tot-dTsll. the correct 
solution is the one that minimizes the function T defined as 



PO y 



Pqt] Dtdy 




1 

^A'^"^ 1 1 W. PGo{zk\xok) Po{xq) 

X jlog j ^pG{zk\xk)P{x)d^ dxodz. (22) 

Detailed derivation of the claim is given in Section |IV] 
The claim implies that the scalar-channel characterization is 
valid for the joint distribution Vix^, a;^), this is, the joint 
distribution V{xq, x^) defined in (|4]i can be asymptotically 
identified as the joint distribution of x^ and a;^ where the 
elements of x^ are independently transmitted over the scalar 
Gaussian channel pGo{z\x) and where the detector postulates 
the channel model pg{z\x) and the modulated version of the 
assumed prior P{x^) (Fig. [U. This result is a finer version 
of the decoupling principle, which is first stated by Tse and 
Hanly [5], and named by Guo and Verdu [2]. 
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Fig. 1. The linear vector channel and the corresponding detector (a). The 
bank of scalar Gaussian channels and their con'esponding detector (b). 



IV. Derivation of the claim 
A. Replica method 

We evaluate V{x^, a;^) defined in (|4]i via replica method. 
Introducing a real number n, ^ can be rewritten as 



Vixk, x^) = lim lim 

A', Af^oon^O 



P{y\Hx)P{x) dx\^ 



P{y\Hx)P{x)dx \ Poiy\Hxa)Poixo)dx'o 



(23) 



According to the standard prescription of replica method, we 
first evaluate 



Zn{xo , xf) = lim Eh 

K. N—^oo 



II I I Pa{y\HXa)Pa{Xa) 

dxY'dx\^ dXa 



(24) 



for a positive integer n, where Pa{y\Hxa) = P{y\Hxa) 
and Pa{x) = P{x) for a = 1, . . . , n, and then the result 
is continuated to real ?? in order to take the limit n ^ to 
obtain 



lim. ^„(a;o , xf) 



n— >0 



Vix^^x"^). 



(25) 



Although there is no rigorous justification for the replica 
method, we assume validity of the replica method and related 
techniques throughout this paper 



B. Average over channel matrix 

To evaluate ( |24] |. we first take the average over the channel 
matrix H. Using the assumptions of random channel matrix 
and memoryless channels, one has 

Zn{x,Q , Xi ) 



h Xr, 



N 



n 71 
X Y\_Pa{Xa)dxl^ dx\^ J^d^Ca, 
a=0 a=2 

where pa{y\u) = p{y\u) for a = 1, . . . , n. We let 



dy 



N 



A 



Eh 



h Xr, 



N 



dy 



N 



(26) 



(27) 



and introduce auxiliary random variables v = {vq, . . . , Vn)'^ , 
Va = h"^ Xa/VK- The average over h in (|27T i can be rewritten 
in terms of an integral over the conditional distribution of v 
given {xa, a = . . . , n}, denoted by F(t)|{a;a}), as 

^-|y V{v\{xa}) Jp^Pa{y\^/Pva) dy d^^ . (28) 

To obtain an explicit expression for y(t>|{a;Q}), we evaluate 
the characteristic function of V^(?;|{a;a}), as 

V{v\{xa})= J e'''"^V{v\{xa})dv 
1 



X <^ 1 



= exp 

3 — K 



2AK 



Wabcd VaVbicVd + O [K ^) > , 



a.b.c.d—0 



(29) 

where i) — {vq, . . . , Vn)"^, where k is fourth-order moment 
of hfj^k, and where (n + 1) x (n + 1) symmetric matrix Q and 
fourth-order symmetric tensor W are defined as 

1 ^' 

Qab = XakXbk (0 < a < 6 < n), (30) 

fc=i 

1 ^ 

Wabcd = 77 X! ^akXbkXckXdk (0 < a < b < c < d < n) . 



fe=i 



(31) 



Note that in the above we have to evaluate F(t}|{a;a}) up to 
0{K^^) terms. The inverse Fourier transform yields 

V{v\{xa}) = Vg{v) - ^Va{v) + 0{K-^), (32) 



where 

Vg{v) = [(2^)"+Mct (Q) 

3 — K 



cxp 



Va{v) = 



24 



Wabcd 



2 



(33) 



a,fc,c,fi— 



dvadvbdvcdvd 



Vg{v). (34) 



Collecting these expressions, we have 

A = cxp 



where 



NgoiQ)-giiQ,w) + o 

GoiQ) = log J Vg{v) jf[Pa (ylV^Va) dy dv , 



(35) 



0=0 



GiiQ, W) 



I Va{v) J Pa {y\VPva) dydv 



(36) 
(37) 



PlVG{v)JU2=0Pa {y\VPVa) dy dv' 

C. Integral over Q and W 

Since the quantity A depends on {xa} only through Q and 
W, one can rewrite ( |26] | in terms of an integral over Q and 
W, as 



= lim 

K, N-too 



exp 



X fixiQ, W; 4, xf)dQdW, 
where 

^lKiQ, W; x^, x^) 



(38) 



'' '' a<a<b<n \ k=l / 

W 5 I Wabcd - ^ X! ^akXbkXckXdk 1 

0<a<6<c<d<?i V k=l / 

n n 

Y[ Pa{Xa) dxl^ dxY W dXa, 



(39) 



and dQ ^ no<a<6<n dQab , dW = no<a<(,<c<d<« dWabcd- 
We evaluate ( [39] l in the large-system limit by following the 
derivation in [6], [7]. We introduce parameters Q = {Qab', < 
a < b < n} undW ^ {Wabcd] < a < b < c < d < n}, 
which are conjugates to Q and W, respectively, and define 
some functions of them for later use: 



^ ^ Qab Xa 



kXbk 



0<a<b<n 



^ Wabcd Xa. 



0<a<b<c<d<n 



K{Q, W-x^,x{) 



f{{Pa{.Xa)dXay (40) 

a=0 ^ 



log 



fc=l 



^ ^ Q ah Xa 



kXbk 



0<a<b<r 



•^ak-^bk^ck-^dk 

0<a<b<c<d<n 



a=0 



a=2 



(41) 



A(g, W)=log f ■■■ [Hexp 
•' k=i 

X akXbkX ckX dk 



0<a<b<c<d<n 



QabXakXbk 

. 0<a<b<n 
n , 

\{\pt{x^a)dx'^a 



(42) 



We further assume that A((5, has a limit as cx) 
Using the functions (I40li-(|42]|. the Fourier transform of 
is given by 



jj-KiQ, W; aJo , x^) = exp 



. .Q .W 



(43) 



and its inverse Fourier transform yields 



Hk{Q, W- 4, x[) = 



exp 



-iW -W - 



X exp 



X^{iQ, iW- x^, x[) - \{iQ, iW) 



dQdW, (44) 



where Q ■ Q and W ■ W are abbreviations of 

"YliOKaKbKnQabQab and '^0<a<b<c<d<n^abcdWabcd, 

respectively. 

To evaluate the integral over Q and W in (l44l i. let Q* = 

{Q:,,; < a < 6 < n} and VK* = {W*bcd^ < a < 6 < c < 
d < n} denote the solution of the equations 

'^"^ ~ — — ' ^'''""^ ~ — ■ 

oQab OWabcd 

Applying three operations to (l44] i: a change of variables 



■ A .Qab , -jT^ .W^abcd , tit* 

iQab + Qab^ iWabcd ^ ^^y^ + W^abcd: 

V A vA 



(46) 



Taylor expansion of A, A^; and A, and a change of integration 
paths to real axes, one can find that the integral in (l44l i leads 
to a Gaussian integration. Then, one obtains 



IIk{Q, W- 4, a;f ) 
X exp 



dot 7^(A|Q*, W*) 



K^-Q-Q* ~W -W* +K{Q*, W*)^ 
K{Q\ W*- 4, x[) - A(Q*, W*) + O (K-i 



(47) 

where 7i(/|u*) represents a Hessian matrix of the function 
f{u) at M = u*. Use of Gaussian integration requires the 
Hessian matrix H{A\Q*, W*) being positive definite. Note 
that a similar evaluation is still possible when T-C{A\Q*, W*) 
is non-negative definite [8]. 



D. Saddle-point evaluation 

We evaluate the integral over Q and W in 
saddle-point method [9]. We obtain 

= lim D exp \KnTn{Q\ W*) - GiiQ*, W*) 
+ XAQ*. W*- x^, x{) - A(Q*, W*) + O {K-^) 
where the function J^„(Q, W) is defined as 



via the 



(48) 



GoiQ) -Q-Q* -W -W* + A(Q*, W*) 



(49) 



Note that Q* and W* depend on Q and W via (gUl. The saddle 
points Q* = {Ql^; < a < b < n} and W* = {W*,,^^; < 
a<b<c<d<n} are determined as the solution of 



dQab 



= 0, 



dT„iQ, W) 



dWa. 



= 0. 



(50) 



bed 



If more than one solution exists for (|50] l, the correct solution 
is the one that maximizes (|49] l. The normalization factor D is 
given by 



D 



det(n{A\Q*, W^*))det(H(-nJ^„|Q*, 1^* 



(51) 



Application of the saddle-point method here requires that the 
Hessian matrix 7i(— riJF„|(5*, W*) is positive definite. 

Since our final result will be a function of Xq and x^, 
we can ignore terms in ( |48] | which are independent of these 
variables, obtaining 



Z„(a;^, x^) (X exp X^{Q* , 0; cc^, a;^) 



(52) 



Note that one obtains Wabcd = by solving (|50] |, and that the 
overall factor, which we have just ignored, can be determined 
via normalization. It turns out, from Wabcd = 0, ( |45] |. and 
(Bol l, that g* and Q* do not depend on W*. 

E. Replica symmetric ansatz 

To proceed further, we assume replica symmetry (RS) [10], 
under which we let 



Qla = Q*ab = 9: 



Qoo - 2*^"' ^*aa-T,G, Q^^ ~ E , Ql^ - (53) 

for positive integers a < b. Then, = liuin^Q !Fn{Q , W) 
is reduced to ( |22] |. and the saddle-point equations (l45T l and 
dSOll become ([I0ll-([l5ll, CI and Go = (For detailed 
derivation, see [10]). Notice that the condition for the Hessian 
matrix 7i(— nJF„|(5*, W*) being positive definite yields the 
de Almeida-Thouless (AT) condition for local stability of RS 
solutions [11]. 



Inserting the RS assumption i53[ into ( |52] |. one obtains 



Yi PGizk\xik)e' 

.k=l 
L 

TT — 

[[ PG{zk\xk)e 

fe=i 



P^{x^)dx^ 



(54) 



fc=l 

Taking the limit n 0, one finally arrives at (|6]l. 

V. Conclusion 

In this paper, we have considered the decoupling principle 
of the linear vector channel. We have shown that the scalar- 
channel characterization obtained via decoupling principle is 
valid for the joint distributions of L (<C K) elements of input 
vector and their estimates based on the posterior probability, 
in the large-system limit. This implies that the scalar-channel 
characterization is valid not only for macroscopic quantities, 
but also for microscopic quantities on the linear vector chan- 
nel. 
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